Dynamical Behavior of a Stochastic Forward-Backward Algorithm Using Random Monotone Operators
نویسندگان
چکیده
The purpose of this paper is to study the dynamical behavior of the sequence produced by a forward-backward algorithm, involving two random maximal monotone operators and a sequence of decreasing step sizes. Defining a mean monotone operator as an Aumann integral, and assuming that the sum of the two mean operators is maximal (sufficient maximality conditions are provided), it is shown that with probability one, the interpolated process obtained from the iterates is an asymptotic pseudo trajectory in the sense of Benäım and Hirsch of the differential inclusion involving the sum of the mean operators. The convergence of the empirical means of the iterates towards a zero of the sum of the mean operators is shown, as well as the convergence of the sequence itself to such a zero under a demipositivity assumption. These results find applications in a wide range of optimization problems or variational inequalities in random environments.
منابع مشابه
A Forward-Backward Projection Algorithm for Approximating of the Zero of the Sum of Two Operators
In this paper, a forward-backward projection algorithm is considered for finding zero points of the sum of two operators in Hilbert spaces. The sequence generated by algorithm converges strongly to the zero point of the sum of an $alpha$-inverse strongly monotone operator and a maximal monotone operator. We apply the result for solving the variational inequality problem, fixed po...
متن کاملStochastic Approximations and Perturbations in Forward-Backward Splitting for Monotone Operators∗
We investigate the asymptotic behavior of a stochastic version of the forward-backward splitting algorithm for finding a zero of the sum of a maximally monotone set-valued operator and a cocoercive operator in Hilbert spaces. Our general setting features stochastic approximations of the cocoercive operator and stochastic perturbations in the evaluation of the resolvents of the set-valued operat...
متن کاملStochastic Quasi-Fejér Block-Coordinate Fixed Point Iterations with Random Sweeping
This work proposes block-coordinate fixed point algorithms with applications to nonlinear analysis and optimization in Hilbert spaces. The asymptotic analysis relies on a notion of stochastic quasiFejér monotonicity, which is thoroughly investigated. The iterative methods under consideration feature random sweeping rules to select arbitrarily the blocks of variables that are activated over the ...
متن کاملA Splitting Algorithm for Coupled System of Primal-Dual Monotone Inclusions
We propose a splitting algorithm for solving a coupled system of primal-dual monotone inclusions in real Hilbert spaces. The proposed algorithm has a structure identical to that of the forward-backward algorithm with variable metric. The operators involved in the problem formulation are used separately in the sense that single-valued operators are used individually and approximately in the forw...
متن کاملAlmost sure convergence of the forward-backward-forward splitting algorithm
In this paper, we propose a stochastic forward–backward–forward splitting algorithm and prove its almost sure weak convergence in real separable Hilbert spaces. Applications to composite monotone inclusion andminimization problems are demonstrated.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- J. Optimization Theory and Applications
دوره 171 شماره
صفحات -
تاریخ انتشار 2016